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Abstract. We give a formula that expresses the Hilbert series of one-sided ladder 
determinantal rings, up to a trivial factor, in form of a determinant. This allows 
the convenient computation of these Hilbert series. The formula follows from a de- 
terminantal formula for a generating function for families of nonintersecting lattice 
paths that stay inside a one-sided ladder-shaped region, in which the paths are 
counted with respect to turns. 



1 Introduction 

Work of Abhyankar and Kulkarni |l|f^, po|j2"l| | , Bruns, Conca, Herzog, and 
Trung ]4]f||f|]li"| showed that the computation of the Hilbert series of ladder 
determinantal rings (see Section || for precise definitions and background) 
boils down to counting families of n nonintersecting lattice paths with a given 
total number of turns in a certain ladder-shaped region. Thus, this raises the 
question of establishing an explicit formula for the number of these families 
of nonintersecting lattice paths. 

In the case that there is no ladder restriction, Abhyankar |l], (20.14.4)] has 
found a determinantal formula for the Hilbert series (actually not just one, 
but a great number of them) . As was made explicit in [||[7|j2l],|22| , he thereby 
solved the aforementioned counting problem in the case of no ladder restric- 
tion. For direct proofs of the corresponding counting formula sec |T^j2^]. In 
the case of one-sided ladders, Kulkarni |H| established an explicit solution 
to the counting problem for n = 1 (i.e., if there is just one path; this corre- 
sponds to considering one-sided ladder determinantal rings defined by 2 x 2 
minors). For arbitrary n, a determinantal formula for the number of families 
of n nonintersecting lattice paths in a one-sided ladder, where the starting 
and end points of the paths are successive, was given by the first author and 
Prohaska |l7j (this corresponds to one-sided ladder determinantal rings de- 
fined by (n + 1) x (n + 1) minors), thereby proving a conjecture by Conca 
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and Herzog |], last paragraph] . Finally, Ghorpade || has recently proposed a 
solution to the counting problem with more general starting and end points 
of the paths, even in the case of two-sided ladders (this corresponds to two- 
sided ladder dctcrminantal rings cogenerated by a given minor). This solution 
is based on an explicit formula for the counting problem for one path (i.e., 
n — 1), which is then summed over a large set of indices with complicated 
dependencies. Thus, this solution cannot be regarded as equally satisfying as 
the determinantal formula of Abhyankar and the determinantal formula of 
the first author and Prohaska, which are, however, only formulas in the case 
of a trivial ladder and in the case of a one-sided ladder, respectively. 

The purpose of this paper is to provide a determinantal formula for the 
case of one-sided ladders where the starting and end points are more general 
than in fl^j (see Corollary [l]; this corresponds to one-sided ladder determi- 
nantal rings cogenerated by a given minor) . This formula must be considered 
as superior to the aforementioned one by Ghorpade in this case (i.e., 
the case of one- instead of two-sided ladders). It specializes directly to Ab- 
hyankar's formula |], (20.14.4), L = 2, k = 2, with F^ 22 \m,p, a, V) defined 
on p. 50] in the case of no ladder restriction. On the other hand, if starting 
and end points are successive, then it does not specialize to the formula in 
[ 17 . (As already mentioned in Section 7 of (lTj , it seems that the formula in 
[17 cannot be extended in any direction.) 

The entries in the determinant in our formula (^J), respectively (|^), are 
given by certain generating functions for two-rowed arrays, which are easy 
to compute as we show in Section ^. (The concept of two-rowed arrays was 
introduced in Jl2|,[l8| and developed to full power in |ll||l4]]. Also the proof 
of the main theorem in jlTj depended heavily on two-rowed arrays.) 

In the next section we recall the basic setup. In particular, we define 
ladder determinantal rings and state, in Theorem [l], the connection between 
the Hilbert series of such rings and the enumeration of nonintersecting lattice 
paths with respect to turns. Our main result, the determinantal formula for 
the Hilbert series of one-sided ladder determinantal rings cogenerated by a 
given fixed minor, is stated in Corollary [l] in Section [| It follows from a 
determinantal formula for counting nonintersecting lattice paths in a one- 
sided ladder with respect to turns, where the starting and end points are 
allowed to be even more general than is needed for our main result. This 
counting formula is stated in Theorem |^, and it is proved in Section ^|. In 
Section |^ we show how to compute the generating functions for two-rowed 
arrays that appear in the determinant of our formula. 



2 Ladder determinantal rings and the enumeration of 
nonintersecting lattice paths with respect to turns 

Let X = (Xj ):7 ')o<i<6, o<j<a be a (6 + 1) x (a + 1) matrix of indeterminates. 
Let = (li,j)o<i<&, o<.j<a be another (6+ 1) x (a + 1) matrix with the property 
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that Yij = Xij or 0, and if Y iy j — Xij and Y^y = Xyy, where % <%' and 
3 < j', then Y S:t — X S:t for all s, t with i < s < i' and j < t < f . An example 
for such a matrix Y, with b — 15 and a = 13 is displayed in Figure 1. (Note 
that there could be 0's in the bottom-right corner of the matrix also.) Such 
a "submatrix" Y of X is called a ladder. This terminology is motivated by 
the identification of such a matrix Y with the set of all points (j, b — i) in the 
plane for which Yij — Xij. For example, the set of all such points for the 
special matrix in Figure 1 is shown in Figure 2. (It should be apparent from 
comparison of Figures 1 and 2 that the reason for taking (j, b — i) instead 
of (i, j) is to take care of the difference in "orientation" of row and column 
indexing of a matrix versus coordinates in the plane.) In general, this set of 
points looks like a (two-sided) ladder-shaped region. If, on the other hand, we 
have either Yo,o = ^o,o or Y~^ a = Xb, a then we call Y a one-sided ladder. In 
the first case we call Y a lower ladder, in the second an upper ladder. Thus, 
the matrix in Figure 1 is an upper ladder. 



/oooooooo ^6,8 -*6, 9 ^6,io -*6,u ^16,12^6,13 \ 

00000000 ^,8 ^4,8 ^,1)^,11^,12^1,13 
00000000 -^,8^,9^2,10^2,11^,12^,13 
^S,7 -^3,8 -^,9^,10^,11^3,12^1,13 
-^,6 ^4,7 -^1,8 ^4,9^,10^,11^4,12^4,13 
^5,5 ^5,6 -^5,7 -^5,8 ^5,9 ^5, 10 ^5,11 12 13 
-^6,4 -^6,5 -^6,6 -^6,7 -^6,8 -^6, 9 -^6, 10 -^6, 11 ^6, 12 ^6, 13 
-^7,4 -^7,5 -^7,6 -^7,7 -^7,8 -^7,9 -^7,10 -^7,11 -^7,12 -^7,13 
^8,4 -^1,5 -^,6 -^1,7 -^8,8 -^8,9 ^,10^,11-^8,12^8,13 
-^9,0 -^,1 -^6,2 -^6,3 -^1,4 -^1,5 -^),6 -^9,7 -^9,8 ^,9^,10^,11^,12^6,13 
-^10,0 -^0,1 -%>,2 -^0,3 -^10,4 -^10,5 -^10,6 -^10,7 -^10,8 -^0 , 9 -^10 , ID^IO , ll-^ , uXtf} , 13 
^5l,0 -^11,1 -^01,2 -^01,3 -^31,4 -^1,5 -^1,6 -^11,7 -^11,8 ^1,9^1,10-^11,11^1,12^11,13 
-X|2 , , 1 Xi2 , 2 Xi2 , 3 -^12 , 4 ^12 , 5 ^12 , 6 ^12 , 7 ^12 , 8 -^12 , 9 ^12 , 10^12 , ll^i2 , 12^12 , 13 
-^13,0 ^,1 -^13, 2 -^13, 3 -^13, 4 ^13,5 -^13, 6 -^13,7 -^33,8 -^13 , 9 -^13 , 1>^13 , ll^i3 , 12-^13 , 13 
-Al4,0 ^4,1 -Xl4,2 -^14, 3 -Xl4,4 ^14,5 -^14,6 -Xl4,7 ^14,8 -^14 , 9 ^14 , 10-^14 , 11^4 , 12-^14 , 13 
^5,0 -^15,1 -^15,2 -^15,3 -^15,4 -^15,5 -^IS , 6 -^15,7 -^15,8 -^15 , 9 ^5 , ID-^ , ll^m , 12-^15 , 13 

Fig. 1. 



Now fix a "bivector" M = [u\, 112, ■ ■ ■ , u n \ v\, V2, ■ ■ ■ , v n ] of positive inte- 
gers with u\ < U2 < ■ ■ ■ < u n and v\ < V2 < • • • < v n . Let K[Y] denote the 
ring of all polynomials over some field K in the Yij's, < i < b, < j < a, 
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Fig. 2. 



and let Im(Y) be the ideal in K [Y] that is generated by those t X t minors 
of Y that contain only nonzero entries, whose rows form a subset of the last 
Uf — 1 rows, or whose columns form a subset of the last Vt — 1 columns, 
t = 1, 2, . . . , n + 1. Here, by convention, u n +\ is set equal to b + 2, and 
is set equal to a + 2. (Thus, for f = n + 1 the rows and columns of minors are 
unrestricted.) The ideal Im(Y) is called a ladder determinantal ideal cogener- 
ated by the minor M . (That one speaks of 'the minor M' has its explanation 
in the identification of the bivector M with a particular minor of Y, cf. 0, 
Sec. 2}. It should be pointed out that our conventions here deviate slightly 
from the ones in fll|| . In particular, we defined the ideal Im(Y) by restricting 
rows and columns of minors to a certain number of last rows or columns, 
while in it is first rows, respectively columns. Clearly, a rotation of the 
matrix by 180° transforms one convention into the other.) The associated 
ladder determinantal ring cogenerated by M is Rm(Y) := K Y] / Im (Y). (We 
remark that the definition of ladder is more general in Jl^ E 



1 111 . However, 



there is in effect no loss of generality since the ladders of nj can always 

be reduced to our definition by discarding superfluous 0's.) 

When Abhyankar introduced ladder determinantal rings in the early 
1980s, he was motivated by the study of singularities of Schubert varieties. 
Indeed, as was shown recently by Gonciulea and Lakshmibai in |l(| (see also 
H Ch. 12]), the associated varieties (called ladder determinantal varieties) 
can be identified with opposite cells of certain Schubert varieties of type 
A. This connection allowed them to identify the irreducible components of 
such Schubert varieties in many cases, thus making substantial progress on 
a long-standing problem in algebraic geometry. 

Results of Abhyankar jl]|2| or Herzog and Trung |ll[ allow to express 
the Hilbert series of the ladder determinantal ring Rm(Y) in combinatorial 
terms. Before we can state the corresponding result, we need to introduce a 
few more terms. 
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When we say lattice path we always mean a lattice path in the plane 
consisting of unit horizontal and vertical steps in the positive direction, see 
Figure 3 for an example. We shall frequently abbreviate the fact that a lattice 
path P goes from A to E by P : A — > E. 



Po 



Fig. 3. 

Also, given lattice points A and E, we denote the set of all lattice paths 
from A to E by T{A -> E). A family (Pi, P 2 , . . . , P„) of lattice paths 
Pi, i = 1,2, ...,n, is said to be nonintersecting if no two lattice paths 
of this family have a point in common. Given n-tuples of lattice points 
A = (4W,i( 2 l,...,iW) and E = (E^ , E&\ . . . , E^), we denote the 
set of all families (Pi, P 2 , . . . , P n ) of nonintersecting lattice paths, where Pj 
runs from A® to E®, i = 1, 2, . . . , n, by P+(A -> E). 

A point in a lattice path P which is the end point of a vertical step and at 
the same time the starting point of a horizontal step will be called a north-east 
turn (NE-turn for short) of the lattice path P. The NE-turns of the lattice 
path in Figure 3 are (1, 1), (2, 3), and (5, 4). We write NE(P) for the number 
of NE-turns of P. Also, given a family P = (Pi, P 2 , . . . , P n ) of paths Pi, we 
write NE(P) for the number Yl7=i NE(Pj) of all NE-turns in the family. 

Our lattice paths will be restricted to ladder-shaped regions L correspond- 
ing to the nonzero entries of a given matrix Y in the way that was explained 
earlier (cf. Figures 1 and 2). We extend our lattice path notation in the fol- 
lowing way. By Vl (A — > E) we mean the set of all lattice paths P from A to 
E all of whose NE-turns lie in the ladder region L. (It should be noted that, 
in the case of a two-sided ladder, it is possible that a path is not totally inside 
L while its NE-turns are. However, in the case of an upper ladder L, which is 
the case of interest for our main results Theorem ^ and Corollary a path is 
inside L if and only if all of its NE-turns are.) Similarly, by (A — > E) we 
mean the set of all families (Pi, P 2 , . . . ,P n ) of nonintersecting lattice paths, 
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where Pi runs from to £w and where all the NE-turns of Pi lie in the 
ladder region L. 

Finally, given any weight function w defined on a set Ai, by the generating 
function GF(vW; w) we mean J2xeM w ( x )- 

Theorem 1. Let Y = {Yi,j)a<i<b. o<j<a be a (two-sided) ladder, and let L 
be the associated ladder region, i.e., Y^j = X. L j if and only if (J, b—i) G L. Let 
M = [m, U2, ■ ■ ■ , u n I t>i, ua, . . . , v n] be a bivector of positive integers with u\ < 
U2 < ■ ■ ■ < u n andvi < V2 < • • • < v n . Furthermore, let A"' — (0, u n +i_i — 1) 
and E^ = (a — v n +i-i + 1, b), i = 1,2, ... ,n. Then, under the assumption 
that all of the points A^ and i = 1, 2, . . . , n, lie inside the ladder region 
L, the Hilbert series of the ladder determinantal ring Rm(Y) = K[Y]/Im(Y) 
equals 

V^- o ™ i GF(P+(A^E);z NE (-)) 

where Rm(Y)£ denotes the homogeneous component of degree £ in Rm(Y), 
and where, according to our definitions, GF(V^(A — > E);z NE (')) is the gen- 
erating function J2p z NB ' p ' for all families P = (Pi, P%, . . . , P n ) of nonin- 
tersecting lattice paths, Pi running from A^' to E^ l \ such that all of its 
NE-turns stay inside the ladder region L. 

Remark 1. The condition that all of the points A^> and E^' lie inside the 
ladder region L restricts the choice of ladders. In particular, for an upper 
ladder it means that F fe _ Un+ i )0 = AV« n +i,o and Y 0ia -v„+i = Xo, a -v„+i, 
which will be relevant for us. Still, one could prove an analogous result even 
if this condition is dropped. In that case, however, the points AW and 23 W 
have to be modified in order to lie inside L and, thus, make the right-hand 
side of formula ([!]) meaningful. 

Sketch of Proof. In |L7| proof of Theorem 2] , we gave two proofs of this asser- 
tion in the special case of a one-sided ladder and Ui — Vi = i, i = 1,2, ... ,n 
(cf. Example (1) on p. 10 of 111]]). The first proof followed basically consid- 
erations by Kulkarni [po|pl|| (sec also ||), and was based on an explicit basis 
for Rm(Y) given by Abhyankar jl], Theorem (20.10)(5)]. The second proof 
was based on combinatorial descriptions of the dimensions Rm(Y)i of the 
homogeneous components of Rm(Y) due to Herzog and Trung O, Cor. 4.3 
+ Lemma 4.4]. Both proofs carry over verbatim to our more general situation 
because both Abhyankar's as well as Herzog and Trung's results are in fact 
theorems for the general ladder determinantal rings that we consider here. 
(However, the reader must be warned that the explicit form of Abhyankar's 
basis was misquoted in JlTj. The correct assertion is that, given a multiset S 
as described in ]T^ ], the associated basis element is the product of a certain 
monomial in the Ajj's and a certain minor of the matrix Y, sec jll definition 
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of w v (t) in Theorem (20.10)] or || Theorem (6.7)(iii)] Also, the definition of 
the multisets S contained an error: Item 2 at the bottom of p. 1019 in fin\ 
must be replaced by: The length of any sequence (ix,ji), (*2, J2), ■ ■ ■ j 3k) 
of elements of S is at most n. The subsequent argument was however based 
on this corrected definition.) □ 



3 The determinantal formula 

In view of Theorem [l], the computation of Hilbert series of ladder determinan- 
tal rings requires to solve the problem of counting families of nonintersecting 
lattice paths in a ladder-shaped region with respect to turns. We provide 
such a solution for one-sided ladders in Theorem |[ In order to formulate the 
result, we need to introduce the notion of two-rowed arrays. 

From now on we restrict our attention to one-sided ladders. Without loss 
of generality it suffices to consider upper ladders. We encode upper ladder- 
shaped regions (such as the one in Figure 2) concisely by means of weakly 
increasing functions as follows: given an upper ladder region L, let / be the 
weakly increasing function from [0, a] to [1,6+1] with the property that it 
describes L by means of 

L = {{x, y):x£ [0, a] and < y < f(x)}. (2) 

Here, by [c, d] we mean the set of all integers > c and < d. In essence, the 
function / describes the upper border of the region L. For example, the 
function / corresponding to the ladder region in Figure 2 (where a = 13 and 
b = 15) is given by /(0) = 7, /(l) = 7, /(2) = 7, /(3) = 7, /(4) = 10, /(5) = 
11, /(6) = 12, /(7) = 13, /(8) = 16, /(9) = 16, /(10) = 16, /(ll) = 16, 
/(12) = 16, /(13) = 16. 

By a two-rowed array we mean two rows of integers 

fl-i+i a-i+2 ■ • ■ «-i a ai . . . a k /„\ 
h . . . b k , {6 > 

where entries along both rows are strictly increasing. We call I the type of the 
two-rowed array. We allow / to be also negative. In this case the representation 
(||) has to be taken symbolically, in the sense that the first row of the two- 
rowed array is (by — I) shorter than the second row, i.e., looks like 

a-1+1 ■ ■■ a k 
b l b 2 ... b-i 6_;+i ... b k . 

We define the size \T\ of a two-rowed array T to be the number of its 
entries. (Thus, the size of the two-rowed array in (S) is / + 2k, as is the 
size of the one in (^).) We extend this definition and notation to families 
T = (Ti,T2, ■ ■ ■ ,T n ) of two-arrays by letting |T| denote the total number 
|Ti| + \T 2 \ + ■ ■ ■ + \T n \ of entries in T. 
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Now we define the basic set of objects which is crucial in our formulas. 
Given a function / as above, and pairs A = (0:1,0:2) and E — {e\^e%), we 
denote by TA(l\ A, E; f, d) the set of all two-rowed arrays of type I such that 

• the entries in the first row are bounded below by ot\ and bounded above 
by £1, 

• the entries in the second row are bounded below by 02 and bounded 
above by £2, 

• if the two-rowed array is represented as in (||) (respectively (||)), we have 

b s < f(a s+d ), (5) 

for all s such that both b s and a s+ d exist in the two-rowed array. 

If we want to make the lower and upper bounds transparent, then we will 
write such two-rowed arrays in the form 

«i < a-i+i a_ i+2 . . . a_i a a x . . . a k < Si , , 

a 2 < h . . . b k < e 2 . 

Our key theorem is the following. 

Theorem 2. Let n, a, b be positive integers and let L be an upper ladder- 
shaped region determined by the weakly increasing function f : [0, a] — > [1,6 + 
1] by means of (^). For convenience, extend f to all negative integers by 
setting f(x) :— /(0) for x < 0. Furthermore, let AW = (A^ ,A|j ) and 
E^ — (e[^ , E^) for i — 1,2, ... , n be lattice points in the region L satisfying 

f{x) = f(A^ ] ) for all x < A[ 1] , (7) 

and 

A« < Af ] <■■■< A^ , A 2 1} > Af > • ■ • > A 2 n) , (8) 

and 

E[ 1} < E[ 2) < ■ ■ ■ < E[ n \ Ei 1} >Ei 2) >--->Ei n \ (9) 

Then the generating function ^z NE ( p \ where the sum is over all families 
P = (P\,P2, . . . ,P n ) of nonintersecting lattice paths Pi : A^ — + E^ l \ i = 
1,2, ... ,71 lying in the region L, can be expressed as 

GF0P+(A^E);z NE ^) 

= det (GF(T J 4(t- S ;iW,^);/, S -l);zl-l/ 2 )), (10) 

l<s,t<n 

where A® = A® + (-i + 1, i) and = E® + (-i, i - 1), i = 1, 2, . . . , n. 
Here, by our definitions, GF(TA(t — s; Aw, E^ ; / , s — l);z^^ 2 ) is the gen- 
erating function ^ T z' T '/ 2 , where the sum is over all two-rowed arrays of 

the form ^) with I = t — s, d = s — 1, a.\ = A^ — i + 1, 02 = Ay + i, 
£1 = — i, and £2 = E% + i — 1, which satisfy 
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Remark 2. (1) The condition (Q) is equivalent to saying that to the left of 
which by (||) is the left-most starting point of the lattice paths, the 
boundary of the ladder region is horizontal. Clearly, this can be assumed 
without loss of generality because this part of the ladder (i.e., the ladder to 
the left of A^) does not impose any restriction on the lattice paths, and, 



hence, on the left-hand side of (10) 



(2) The formula (|Hj) clearly reduces the problem of enumerating families 
of nonintersecting lattice paths in the ladder region L with respect to NE- 
turns to the problem of enumerating certain two-rowed arrays. We are going 
to address this problem in Section |5j. 

Thus, if we combine Theorems [l] and we obtain the promised determi- 
nantal formula for the Hilbert series of one-sided ladder determinantal rings. 

Corollary 1. Let Y = (li.j)o<j<6, a<j<a be an upper ladder, and let L be 
the associated ladder region, i.e., Y^j = X+ t j if and only if (j, b — i) € L, and 
let f : [0, a] — > [1,6+ 1] be the function that describes this ladder region by 
means of (jfy, i.e., Y^j — X^j if and only if b — i < f(j). For convenience, 
extend f to all negative integers by setting f(x) := /(0) for x < 0. Let 
AI = [ui, v>2, ■ ■ • , u n | v i, t>2, ■ • ■ , v n ] be a bivector of positive integers with 
u\ <U2< ■ ■• <U n and V\ < t>2 < ■ ■ ■ < v n such that Yfc- Un +i,o = -X"6-« n +i,0 
and Yo >a — Vn +i = -^0,0— d»+i ( c f- Remark\^ after Theorem ^). Furthermore, 
we let AW = [—i + 1, u n +i-i and E^> = (a — u n _|_i_, — i + l,b + i — 

1), i — 1,2, .. .,ti. Then the Hilbert series of the ladder determinantal ring 
Rm{Y) = K[Y]/I m (Y) equals 



dim 



k Rm{Y)iz 1 



= deti< B|t < n ( GF (TA(t - s; A^,E^;f, s - 1); z^ 2 )) 

~ (1 _ z )(a+6+3)n-E? = i(«i+«i) 



(11) 



Remark 3. (1) Theorem y specializes to Theorem 1 in |1J] in the case of a 
trivial ladder (i.e., if the function / is equal to b + 1 for all x). For, in that 
case, by @) the generating functions GF( TA(t-s; A t ,E s ; f, s-1); z^^ 2 ) can 
be expressed in terms of binomial sums. To see that the resulting formula is 
indeed equivalent, one extracts the coefficient of z . 

(2) For the same reason, Corollary |l| specializes to Abhyankar's formula 
(20.14.4), L = 2, k = 2, with F^ (m,p, a, V) defined on p. 50] in the case 
of a trivial ladder. Although Abhyankar's formula gives an expression for the 
Hilbert function (instead of for the Hilbert series), it is easy to see that it is 
equivalent to ours in this special case. 

(3) The formula for the Hilbert series in |17, Theorem 2] addresses the 
special case Ui — Vi = i, i = 1,2, ...,n. However, Corollary [l] does not 
generalize this formula, as it does not directly specialize to Theorem 2 in |0 . 
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Whereas in the latter formula the entries of the determinant are generating 
functions for paths, there is no such interpretation for the entries of the 
determinant in (|Tl|). 

(4) Unfortunately, we do not know how to generalize Theorem |2| and, 
thus, Corollary [l|, to the case of two-sided ladders. It seems that a completely 
new idea is needed to find such a generalization. 

(5) More modest, but equally desirable, would it be to find an extension of 
Corollary [l] in the one-sided case to ladders L and bivectors M which do not 
satisfy the conditions of the statement, i.e., for which either Y6- u „+i,o = 0, or 
^0,0— t!„+l = 0, or both. This would require to find an extension of Theorem^ 
to situations where the inequality chains (||) and @ may be relaxed so that 
some starting and end points are allowed to lie on the boundary of the ladder 
region L (cf. Remark [j] after Theorem 0) . It seems again that a completely 
new idea is needed to find such an extension. 

(6) In Section 5 of Jl7j it is shown that the proof of the main count- 
ing theorem yields in fact a weighted generalization thereof. An analogous 
weighted generalization of Theorem || can be obtained as well, which is again 
directly implied by the proof of Theorem |^ in Section ||. However, we omit 
the statement of this generalization for the sake of brevity. 

Example 1. Let a = 13, b = 15, n = 4, let Y — (Yi,j) be the matrix of 
Figure 1 and M = [1, 2, 4, 6 | 1, 2, 3, 6]. Our formula ( |ll| ) gives for the Hilbert 
series of Rm(Y) = K[Y]/Im(Y), using fl45| ) for determining the generating 
function Y^TeTAU-A E-f d) z '''^ 2 f° r two-rowed arrays T in the corresponding 
ladder region L of Figure 2, 

(l+71z+2556z 2 +61832z 3 + 1115762z 4 + 15750005z 5 + 178390279z 6 + 1647137174z 7 
+ 12534233703z 8 +79245271879z 9 -M18852424787z 10 + 1859941402206z 11 +6965987806143z 12 
+22071622313567z 13 +59298706514083z 14 + 135299444287353z 15 +262400571075662z 16 
+432640455645309z 17 +606103694379729z ls +720535170430557z 19 +725289798304502z 20 
+616230022969392z 21 +439998448014899z 22 +262469031030333z 23 + 129776697745621z 24 
+52622863698472z 25 + 17241967478923z 26 +4468021840695z 27 +885721405230z 2s 
+ 126901720400z 29 + 11760999250z 30 +532021875z 31 )/(l-z) 99 . 



4 Proof of Theorem § 

The basic idea of the proof is simple. It largely follows the proof of Theorem 4 
in 1 14]]. As a first step, we expand the determinant on the right-hand side of 
([lO) according to the definition of a determinant, see Subsection 4.1. Thus, 



we obtain a sum of terms, each of which is indexed by a family of two-rowed 
arrays, see (|l~2"|). Some of the terms have positive sign, some of them negative 
sign. In the second step, we identify the terms which cancel each other, see 



Subsection 4.2. Finally, in the third step, we identify the remaining terms with 
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the families of nonintersecting lattice paths in the statement of the theorem, 



see Subsection 4.3 



However, the details are sometimes intricate. To show that the terms 



described in Subsection 4.2 do indeed cancel, we define an involution on 



families of two-rowed arrays in Subsection 4.4. (This involution is copied 



from pi, Proof of Theorem 4].) In order that our claims follow, this involution 



must have several properties, which are listed in Subsection 4.5. While most 
of these are either obvious or are already established in |Q and [^3| , we are 
only able to provide a rather technical justification of the one pertaining to 



the ladder condition. This is done in Subsection 4.6 



4.1 Expansion of the determinant 

Let & n denote the symmetric group of order n. We start by expanding the 
determinant on the right-hand side of (|i"o|), to obtain 

det (GF(TA(t-s;A^,E^;f,s- l);z M/2 )) 

l<s,i<n 

n 

= E sgnanGF(T^(a(z)- i ;I^», J B«;/,z-l);zl-l/ 2 ) 
o-ee„ i=i 

= sgntx^l, (12) 

(T>) 

where the sum is over all pairs (T, cr) of permutations a in 6„, and families 
T = (Ti,T2, . . . , T n ) of two-rowed arrays, Ti being of type a{i) — i (i.e., the 
second row containing ki entries and the first row containing ki + — i 
entries, for some ki), and the bounds for the entries of Ti being as follows, 



A 1 s a_ cr(i)+i+1 ... a ± ... a k . S&i 
Ai a(i)) < . . . < E$ 



(13) 



1 2 U X . . . Vj.. ^ jj 2 , 

with the property that 

b?> < /(o^_i), s=l,2,...,ki-i + l, (14) 

i = 1, . . . , n. 

4.2 Which terms in ([121) cancel? 



Now we claim that the total contribution to the sum ( J12| ) of the families 
(Ti,T2, . . . , T n ) of two- rowed arrays as above which have the property that 
there exist Ti and Ti +1 , Ti represented by 

aW*)) <- „ „ „ ^ £>(*) 
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and Tj_|_i represented by 



A[^ +1)) < d 1 ... d t <E{ l+1 \ 



(15b) 



and indices I and J such that 



c,j < a] (15c) 

< dj (15d) 

and 

l<I<fc + l, 0<J<1, (15e) 



equals 0. The inequalities (15c) and (15d) should be understood to hold only 



if all variables are defined, including the conventional definitions a^+i :— 
Ef 1 + 1, b := A^ {i)) - 1, and c_ a{i+l)+i+1 := A^ {i)) - 1. (These artificial 
settings apply for I = k + 1, I = 1, and J = —a(i + 1) + i + 1, respectively. 
It should be noted that the indexing conventions that we have chosen here 
deviate slightly from |l4]. Sec. 3, proof of Theorem 4], but are completely 
equivalent.) 

We call the point (ai,dj) a crossing point of Ti and Tj+i, and, more 
generally, a crossing point of the family T. 



4.3 The remaining terms correspond to nonintersecting lattice 
paths 

Suppose that we would have shown that the contribution to (|l2|) of these 
families of two-rowed arrays equals zero. It implies that only those families 
T = (Ti, T2, ■ . ■ , T„) of two-rowed arrays, T being of the form ( p"3| ) and 
satisfying (ph, contribute to (|l2|) where Tj and Tj+i have no crossing point 
for all i. 

So, let T be such a family of two-rowed arrays without any crossing point. 
By using the arguments from |23|][] (with , , e[^ , E^ in Q replaced 
by our A[ l \ A% — 1, E^ +1, E^p , respectively, % = 1, 2, . . . , n), it then follows 
that the permutation cr associated to T must be the identity permutation. 
Thus, the two-rowed array Ti has the form (recall (|l|)) 

A^Ka? ... o^<E^ 

A$><b? ... 6$ [ 6J 

1 The proof in the original paper Jl4[ last paragraph of the proof of Theorem 4] 
contained an error at this point. The inequality A["( i+1)) - 1 < A {a{i)) on page 12 
of flpl is not true in general. 
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and satisfies (|14|). Moreover, we assumed that there is no crossing point, 
meaning that there are no consecutive two-rowed arrays Tj and Tj+i and 
indices / and J such that ( |l5| ) holds. 

By interpreting the two-rowed array (Iq) as a lattice path p from AW — 



(0,1) to + (1,0) whose NE-turns are exactly (a W ,6 W ), . . . . 
i = 1,2, ... ,n, the family T of two-rowed arrays is translated into a family 
P = (Pi, P2, . . . , P„) of paths. Clearly, under this translation we have |T|/2 = 
NE(P), and, hence, 



fa (i) 



„|T|/2 



„NE(P) 



(17) 



The fact that (|1!|) does not hold simply means that the paths Pj and Pj+i 
do not cross each other (that is, they may touch each other, but they never 
change sides), i = 1,2, . . . ,n — 1. We refer the reader to the explanations in 
Section || (between Theorems 3 and 4) in piy . Here, we content ourselves 
with an illustration. Suppose two paths Qi and Q2 cross each other (see 
Figure 4). Furthermore suppose that the NE-turns of Q\ are (ai, 61), (a 2 , 62), 
. . . , (a/j, bk), and the NE-turns of Q 2 are (c\, di), (C2, ^2), ■ ■ • , {ci, d{). Then 



it is obvious from Figure 4 that there exist I and J such that ( |l5q )-(15e) 
hold. 



■Qi 



(cj,dj) 



(ai, bi-i) 
Fig. 4. 



To finally match with the claim of Theorem ^, we shift p by (i— 1, — i+ 1) , 
i = 1,2, ... ,n. Thus we obtain a family (Pi, P2, . . . , P n ) of lattice paths, Pi 
running from A" to P^^. Clearly, under this shift, the condition that p and 
P;+i do not cross each other translates into the condition that P; and P^+i 
do not touch each other, i = 1, 2, . . . , n — 1. If we combine this fact with the 
observation that the first path, Pi = Pi, stays inside the ladder region L 
because of (|lj) with i = 1, then we conclude that all the Pi's must also stay 
inside L because Pi forms a barrier. 

Thus, in view of (17), we have proved that the right-hand side of (10) is 
equal to the generating function ^ p z NE ( p ) , where the sum is over all families 
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P = (Pi, P2, . . . , P„) of nonintersecting lattice paths, Pj running from to 
2?M and staying inside the ladder region L. But this is exactly the left-hand 
side of (plf). Thus Theorem would be proved. 



4.4 The involution 

To show that the contribution to the sum (P) of the families T = (T x , T 2 , . . . , 
T n ) of two-rowed arrays, Tj being of the form ([l3|) and satisfying ((IJ) for 
i = 1,2,... ,n, which contain consecutive arrays T, and Tj+i that have a 
crossing point (cf. dig)), indeed equals 0, we construct an involution, 99 say, 
on this set of families that maps a family (Ti, T2, . . . , T n ) with associated 
permutation <r to a family T = (Ti, T2, . . . , T„) with associated permutation 
ct, such that 

sgncr = - sgna 7 , (18) 

and such that 



|T| = |T|. (19) 

Clearly, this implies that the contribution to ( p"2| ) of families that are mapped 
to each other cancels. 

The definition of the involution <p can be copied from p4| , Sec. 3, proof of 
Theorem 4]. For convenience, we repeat it here. Let (T, a) be a pair under 
consideration for the sum (|lj). Besides, we assume that T has a crossing 
point. Consider all crossing points of two-rowed arrays with consecutive in- 
dices (see (|l5|)). Among these points choose those with maximal x-coordinate, 
and among all those choose the crossing point with maximal y-coordinate. 
Denote this crossing point by S. Let i be minimal such that S is a crossing 



point of Ti and Ti + \. Let Ti and Tj+i be given by (15a) and ( 15b ), respec- 
tively. By (^), S being a crossing point of Ti and Ti+i means that there exist 
I and J such that T looks like 



A[° (i)) <... ai-i aj... a ki < E® 
4^»<... b T ... b ki <E<?\ 



Ti + i looks like 



< cj c J+1 . . . c ki+1 < E® 

4 CT(i+1)) <... dj-i dj d kl+1 <E^\ 



(20) 



(21) 



S = (ai,dj), 



cj < a/ 
bi-i < dj 



(22a) 
(22b) 
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and 

I < I <k + l, 0<J<k i+1 . (22c) 

Because of the construction of S, the indices I and J are maximal with respect 
to (g). 

We map (T, a) to the pair (T, a o (i, i + 1)) ((i, i + 1) denotes the trans- 
position exchanging i and i + 1), where T = (Ti, T2, . . . , T n ), with = Tj 
for all j ^ 1, with Tj being given by 

... c, a/... a fe< 
. . . g(j_i bi ... bki, 

and with T.; + i being given by 



57-1 aj d ki+1 . 



4.5 The properties of the involution 

What we have to prove is that this operation is well-defined, i.e., that all the 



rows in (23a) and ( |23b[ ) are strictly increasing, that Ti is of type (a o + 
!))(*) — * = cr (* + 1) — h that r, + i is of type (a o (i, i + l))(z + 1) — i — 1 = 
cr(?) — i — 1, that the bounds for the entries of Ti are given by 

4 CT(l+1)) < ■ • • C7 ai ...a ki < 

< . • • dj_ x 61... 6 fei <£f, 

that those for Ti + \ are given by 

< a/_i cj+i . . . c fei+1 < 

ii CT(i)) <... d 7 d* i+1 < 

and that (|l4|) is satisfied for Ti and Tj+i. Furthermore we have to prove that 
cp is indeed an involution (for which it suffices to show that (^|]) also holds 
for Ti and 2V|_i), and finally we must prove ( |l8| ) (with <7 = (7o(i,z + l)) and 
19)). 

The claim that ( |l8| ) and ( |l9|) hold is trivial. All other claims, except for 



the claim about (14), can be proved by copying the according arguments from 
the proof of Theorem 4 in pj (see the paragraphs after |TJ, Eq. (27)]). 

4.6 The involution respects the ladder condition 

It remains to show that (|l4|) is satisfied for Ti and Tj+i. Unfortunately, it is 
necessary to supplement and refine the according arguments in the proof of 
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the main theorem in |j] (see the proof of (4.27) and (4.28) in Q pp. 1035- 
37]) substantially in order to cope with the situation that we encounter here. 
Besides, we use the opportunity to correct an inaccuracy in ]T^ ]. 

We have to prove that for 1 < r < i — 1 we have 

dj_ i+r < /(a/_i +r ), (24) 

provided both a/_i +r and e?j_i +r exist (if either a/_i +r or dj-i +r does not 
exist there is nothing to show), and 

bi-i+r < f(cj +r ), (25) 

provided both fr/-i+ r and cj +r exist (if either or cj+ r does not exist 

there is nothing to show). 

Proof of (|24|). In the following, let r be fixed. We distinguish between two 
cases. If < a/, then we have the following chain of inequalities: 

dj-i+r < dj-i + l- i + r<6/-i + r< 6/-i +r — i + 1 

< E® - * + 1 = Ef < < f{E {X) ) < f(aj) < /(oj-i+r), (26) 

as required. (The second inequality in ( p6f ) follows from the fact that the rows 
in (23a) are strictly increasing.) 

Otherwise, if E±' > aj, let us assume for the purpose of contradiction 
that (Q) does not hold. Then, because of the first two inequalities in ((2^) we 
have dj-i^ r < bi, and hence 

f(ai) < f(ai- l+r ) < dj- i+r < bj. (27) 

In more colloquial terms, the point (a/, bi) lies outside the ladder region L 
defined by (§). 

(j) 

For the following, we make the conventional definitions a , •>, := 
^(^O)) _ ^ ajj. +1 := E± + 1 (which is in accordance with the conventional 

definition for cik+i in (p"5|)), and 6q := — 1 (which is in accordance 

with the conventional definition for &o m (Ft))- 

For any j < i we claim that, if for the two-rowed array T) + i (given by 
( pil ) with i replaced by j + 1) we find a pair (0^+1,6^+1) of entries (i.e., 
&s!'+i and exist in T J+ i or are defined by means of one of the above 

conventional definitions) such thatQ 

and bj < b%+}\ (28) 



2 It is at the corresponding place where the inaccuracy in occurs. On p. 1036 
the inequality chain aj > x s > ■ ■ ■ > ut has to be replaced by a/ > x a , . . . , 
ttj > ut, and the inequality chain bi < y 3 < ■ ■ ■ < v t has to be replaced by 
bi <y s , ... , bi < Vt. 
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then we can find an h < j such that the two-rowed array Th contains a pair 
(a!i^ , b^ 1 } ) satisfying the same condition, that is 

ai >a ( ^ and b I <b{ h) . (29) 

In other words, we claim that if in Tj + \ we find a pair of entries which, when 
considered as a lattice point, is located (weakly) northwest of (a/, 6/), then 
we will also find such a pair in Th for some h < j. 

Let us for the moment assume that we have already established the claim. 
Clearly, for j = i — 1 the condition ( p8| ) is satisfied with s 3+ i = /, in which 

case we have aH+i = af = o-i and bWf^ — bj — bj. Then, by iterating the 
assertion of our claim, we will find that (|2|) is satisfied for h = 1 and some 
s\. Using this and ( p7| ) we obtain 

/(<#>) < f{aj) <b!< &« 

However, this inequality contradicts the fact that T\ obeys the ladder con- 
dition ( p^ ) with i = 1 and s = s\. Hence, inequality ( pi| ) must be actually 
true. 

For the proof of the claim, we distinguish between four cases: 

(i) > j and a!f> < a/; 

(ii) < j and a°^ 0)+J+1 < ai\ 
(hi) > J and a[ 3) > a/; 

(iv) a(J) < j and a^ (j)+J+1 > a 7 . 



Case cr(ji) > j and < a/. Because we are assuming e[^ > a/, we have 
ai < e[ 1] - 1 = e[ 1] < e[ j) . Therefore it is impossible that a[ j) = e[ j) + 1 
(by one of our conventional assignments), and hence does indeed exist, 
i.e., kj > 1 (cf. ( |l3| ) with i replaced by j). 

Let Sj be maximal such that ai} < aj. By the above we have 1 < Sj < kj. 
Therefore bi} exists. If bi} < then we have ai^ < a/ < a~7 +1 and bi} < 

bi < bi^ ■ But that means that (Og? +1 , &sj+i ) is a crossing point of Tj and 
T J+1 (cf. ( |l 5<j ) ( |l5e| ) ) with larger x-coordinate than (a/,dj), contradicting 

the maximality of the crossing point (a/, dj). Hence, we actually have bi} > 
bi, and thus ( p9| ) holds with h — j and with Sj as above. 



Case cr(j) < j and a^./^^ < a/. The arguments from the above 

( 7 } ( 7 ) 

case apply verbatim if one replaces by a -cr(j)+j+i everywhere. 
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Case er(j) > j and > a,/. We show that this case actually cannot 
occur. Because of (0), we have f(A^) < /(a/), and therefore 

= 4 CT(i)) - 1 < ^ - 1 = 4 X) < /(4 X) ) < /(«/) < 6/ < b%+?, 

the two last inequalities being due to ( p7|) and On the other hand, we 
have asj+^ < a/ < . This means that (o^ , &a^£^) is a crossing point of 
Tj and Ij+i with larger ^-coordinate than (ai,dj), which contradicts again 
the maximality of (a/, dj). 



Case <t(j) < j and a^ (j)+J+1 > a/. If < tncn we have 

a^+i 5 < a/ < affiy )+i+1 and b^} a{j)+ . < 6/ < 6g+ 1} . This means that 

( a ^a(j)+j+ii ^ ) is a crossing point of Tj and Tj+i with larger x-coordinate 

than (aj,dj), a contradiction. Therefore we actually have b_,^ + ^ > bj. 

If a U) aU)+j = A[ aU)) - 1 < ai then @ is satisfied with h = j and 

Sj = —<j{j) + j- If, on the other hand, ajf^r^+j > a /j then of course ( p9| ) 
cannot be satisfied for h = j and any legal Sj. However, we can show that it 
is satisfied for some smaller h. 

Let us pause for a moment and summarize the conditions that we are 
encountering in the current case: 

<y(j) < J, > ai and b% j)+] > bj. (30) 

Clearly, there is a maximal s with s < a(j) < u(s). We are going to show 
that we can either find an h < j and a legal Sh such that (|2^) is satisfied, 
or we find an index £ < j such that (|3^) is satisfied with j replaced by £ 
(in which case we repeat the subsequent arguments), or we can construct a 
sequence of pairs (a!fi,b$), r e e {1,2, ... ,k^} tor £ G {s + 1, s + 2, . . ., j — 1} 
that satisfy 

> 4? > aj and > fcg£> > bj, (31) 



where, in order that (|31[) makes sense for £ = j — 1, we set rj = —cr(j) + j. 

However, if we have found such pairs for £ £ {s + l,s + 2, — 1}, then 
we have 

a I a r s + 1 a _ CT (j) + j ' l 

< + <r(i) - s < i^ (s)) + cx(s) - s < a[ s) 

and 

°0 — ^2 1 ^ A 2 1 ^ U -a(])+j ~ U rj - U r s + 1 ■ 



The Hilbert series of ladder determinantal rings 



19 



This means that (a\ s ' ,br s+1 ) is a crossing point of T s and T s+1 with larger 
^-coordinate than (ai,dj), contradicting again the maximality of (aj,dj). 
Therefore we will actually find an h < j such that ( |29| ) is satisfied. 

We prove our claim in ( pl| ) by a reverse induction on I. (The last two 
inequalities in ( p0[ ) guarantee that the induction can be started.) Suppose 
that we have already found indices rj—i, rj_2, • ■ ■ , satisfying (pl|). Then 
we distinguish between the two cases a(£) > £ and a(£) < £. 

First let us consider the case a(£) > I. If af^ > a^l\ then we have 
a i < ftrf+i 1 ' < Cbf^ and, if in addition I > er(j), we have 

Al) _ 7(<r(r» _ 7(<r(j)) _ 1 .0') _ < . (£+1) 



where the first inequality is due to o(£) > I > a(j). This means that 
(aj , ?>rf+i ) is a crossing point of Tg and Tg + i with larger x-coordinate than 
(ai,dj), again a contradiction. 

If £ < <j(j), we can also prove that 6q < , giving the same con- 

tradiction. However, this time we must argue differently. Since £ > s, all 
of cr(£ + 1), ct(£ + 2), . . . , a(a(j j) must be less than a(j). For that reason, 
because of a(£) > £ and the pigeon hole principle, there must be a t £ 
{£+ 1,£+ 2, . . .,<r(j)} with cr(i) < <r(f). Then, by ©, we obtain 

b w = zgm _ ! < ^w) _ ! < 6 w < 

Hence, we actually have < Or*+i ■ 

We also have E^ > A± s " + er(s) — s — 1, because otherwise there would 
not be any two-rowed array T s (see ( |T3| ) with i = s), i.e., the family T of 
two-rowed arrays that we are considering would not exist, which is absurd. 
This implies the inequality chain 

Ef ] > E[ s) > 4 CT(S)) + a{s) -s-1 

> A^ + a(j) -s-l> - 1 = a% j)+j > 

Therefore it is impossible that = e[^ + 1 (by one of our conventional 
assignments), and hence af does indeed exist, i.e., kg > 1. 

Now let rg be maximal, such that a rt < a re+1 ■ By the above we have 1 < 
rg < kg. If b$ < br l e ^l\ then we have etj < < a^ +1 and &£/ < b^^_\\ 

This means that (a^ +1 , &rt+i"') is a crossing point of Tg and Tg+\ with larger 
^-coordinate than (a/,dj), which is once more a contradiction. 

Hence, we actually have bf) > b^^_\\ Therefore, if a$ < a/ then @ 
is satisfied with h = £ and Sh — re, and otherwise, if a$ > ai then ( pl| ) is 
satisfied. 
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As a last subcase, we must consider o~(£) < £. Again we have to distinguish 
between two cases: if a_L« + ^ +1 < a^^W we argue exactly as in the above 
case where a(£) > i and a^p < aiftl ■ (We just have to replace a± by 
^li^+i+x there.) Otherwise, if a^ (<)+m > we get i>™ w+i > , 

because otherwise ai < ai^l^ < a_ a / e \ +i+1 an< ^ -]r<e)+£ < ^l+i s an< ^ thus 

( a -cr(f)+^+i' ^+1**) * s a crossing point with larger ^-coordinate than (a/, rfj), 
again a contradiction. 

Now, if a^L« + ^ < ai then ( p9| ) is satisfied with h = £ and Sh = —<j{£) + £. 

On the other hand, if a_ a ,^ +i > aj then ( |30| ) is satisfied with j replaced 
by £ In addition we have £ < j. Consequently, we repeat the arguments 
subsequent to (|3(]) with j replaced by £. In that manner, we may possibly 
perform several such iterations. However, these iterations must come to an 
end because <r(l) > 1, and, hence, the conditions ( |30| ) cannot be satisfied for 

i = i. 



Proof of (|2^) . We proceed similarly. We first observe that we must have 
ai < cj+i, because otherwise we would have cj+i < a/ and by (15d) also 
< dj < rfj+i, which means that (a/,<ij+i) is a crossing point of Ti 
and Ti + i, contradicting the maximality of (a/, dj). Now we distinguish again 
between the same two cases as in the proof of (|24|). If E± < Oj, then we 
have the following chain of inequalities: 



bi-i+r < i +1 — i + r<rfj — i + r< dj +r — z 

< E^ - i = E^ +1) < < /(^f >) < /(az) < /( CJ+1 ) < /(c J+r ), 

(32) 

as required. (The second inequality in ( p2| ) follows from the fact that the rows 
in ( |23b| ) are strictly increasing.) If on the other hand we have E± ' > dj, then 
let us assume for the purpose of contradiction that (|2^) does not hold. This 
implies 

f(ai) < /(c./+r) < < bi. 

Again, this simply means that the point (a/, 6/) lies outside the ladder region 
L defined by @) . We are thus in the same situation as in the above proof of 
(p4|), which, in the long run, led to a contradiction. 

This completes the proof of the theorem. 



5 Enumeration of two-rowed arrays 

The entries in the determinant in ( |l0| ) and ([ll]) are all generating functions 
zl T l/ 2 for two-rowed arrays T. Hence, we have to say how these can be 
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computed. Of course, a "nice" formula cannot be expected in general. There 
are only two cases in which "nice" formulas exist, the case of the trivial ladder 
(i.e., f{x) = b+1; see (|37|)), and the case of a ladder determined by a diagonal 
boundary (i.e., f(x) = x + D + 1, for some positive integer D; see (|3^)). In 
all other cases one has to be satisfied with answers of recursive nature. 

We will describe two approaches to attack this problem. The first leads 
to an extension of a formula due to Kulkarni |^0| (see also jlT], Prop. 4]) for 
the generating function of lattice paths with given starting and end points in 
a one-sided ladder region. The second extends the alternative to Kulkarni's 
formula that was proposed in Jl7], Prop. 5-7]. The first approach has the 
advantage of producing a formula (see Proposition [[] below) that can be 
compactly stated. The second approach is always at least as efficient as the 
first, but is by far superior for ladder regions of a particular kind. This is 
discussed in more detail after the proof of Proposition [|. 

Proposition 1. Let f be a weakly increasing function f : [0, a] — > [l,b+ 1] 
corresponding to a ladder region L by means of (^|) 7 as before. Extend f 
to all integers by setting f(x) := a 2 for x < and f(x) := £2 + 1 for 
x > a. Let ax — 1 < Sk-i < ■ ■ ■ < s\ < e\ be a partition of the (integer) 
interval [a\ — 1, e±] such that f is constant on each subinterval [si + 1, s»— i], 
i = k, k — with Sfc := ai — 1 and sq '■= £i- Then the generating 

function ^2 z' T '^ 2 for all two-rowed arrays T of the form (^) and satisfying 
(^|) is given by 



GF(TA(l;(a u a 2 ),( Sl ,e 2 );f,d);z^ 2 ) 



k 



e+d>f>0 i=l V 1 V h Jl - 1 / 

where e = (ei, e 2 , ■ ■ ■ , e^) and f = (/i, f 2 , ■ ■ ■ , fk), where, by definition, cq = 
fo = 0, where e + d > f > means e\ + d > fi > 0, i — 1, 2, . . . , k, and 
where f'(x) agrees with f(x) for a± < x < e\, but where f {pL\ — 1) = a 2 and 
f'(si) = s 2 + 1. (All other values of f are not needed for the formula (p3|)). 

Proof. Let T be a two-rowed array in TA(l\ (ai,a 2 ), (e\, e 2 ); f, d), represented 
as in (||) . Suppose that there are entries in the first row of T that are larger 
than Si , and that there are fi entries in the second row of T that are larger 
than or equal to /(si), i = 1, 2, . . . , k. Equivalently, we have 

£i = so > ai > • • • > a ei > si > a ei+ i > ■ ■ ■ > a e2 > s 2 

> ■ ■> s fe _i > a efc _ 1+ i > • • • > a Ck > s k = ai - 1, (34) 

and 

/'(s ) = £ 2 + 1 > b 1 > ■■■>b h > f(sx) > b h+ i >•••>&/„> f(s 2 ) 

> ■ > f(s k -i) > b fk _ 1+1 >--->b fk > f'(s k ) = a 2 . (35) 
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In particular, we have e& — fk = I- From (|^) it is immediate that we must have 
&i + d > fi > 0. Conversely, given integer vectors e and f with ei + d > fi > 
and eu — fk =1, by ( |34| ) and (|3|) there are 

-pr / S 4 _i - sA / /(Sj-i) - /(s;)\ 

possible choices for the entries a% and bj, i = 1, 2, . . ■ , in the first and second 
row of a two-rowed array which satisfies ([m|) and ([35]), and thus (||). This 
establishes (|33|). □ 



Remark 4- If in Proposition [l] we set Z = e? = 0, then we recover Kulkarni's 
formula |20, Theorem 4] (see also [jl7|, Prop. 4]), because the two- rowed ar- 
rays in TA(0; (0:1,02), (£1,62);/, 0) can be interpreted as lattice paths with 
starting point (a%, 02 — 1) and end point (ei + 1, £2) which stay in the ladder 
region defined by /. 

Now we describe the announced alternative method to compute the gener- 
ating function ^2 -z' T '/ 2 for two-rowed arrays T of the form (^) which satisfy 
(||). For sake of convenience, for A = (01,02) and E = (£1,62) as before, 
01 < £1, we introduce the set 

TA*(l; A, E; /, d) = TA(l; A, E; f, d) \ TA(l; A + (1, 0), E; f, d), (36) 

which is simply the set of those two-rowed arrays of the given form whose 
first entry in the first row equals oi. 

This second method is based on the simple facts that are summarized in 
Propositions |]-[|. The propositions extend in turn Propositions 5-7 in |l7j . 
In the following, all binomial coefficients (^) are understood to be equal to 
zero if n is negative and k is positive. 

Proposition 2. Let L be the trivial ladder determined by the function f(x) = 
b+l by means of (j^). Let A — (ai, 02) o-nd E = (ex, £2) be lattice points and 
I and d arbitrary integers. Then we have 



GF ( TA(l; A, E; /, d); z^) = £ ( £l " ^ + J ) h ^ + 1 \- >< < 1 > 



(37) 



and if a\ < £\ we have 



GF ( TA*(l; A, E; /, d); z^) = £ !\) ( £2 " * + ') ^\ (38) 
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Proposition 3. Let Ld be a "diagonal" ladder determined by the function 
f(x) = x + D + 1 for an integer D by means of (|^). Let d be a nonnegative 
integer and I an integer such that l + d > 0. Let A = (a\, 012) and E = [e-y, £2) 
be lattice points such that a± + D + l + l + d>ct2 and £\ + D + 1 + d> £2- 
Then we have 



GF(TA(l;A,E;f,d); 



* ii/2 ) = e( 



£1 - ai + 1\ /e 2 - a 2 + 1 
k+l )\ k 



k-d-1 ){ k+l+d+1 , 



z k+l/2 , (39) 



and if ot\ < e% we have 

GF (TA*(l;A,E;f,d);z^ 2 )=Y / 



' £\ — OL\ \ (ei — a.i + 1 
± + l - 1 \ k 



£1 - a 2 + D + 1\ /e 2 - ai - 
k-d-1 J\ k+l+d , 



Ufc+2/2 



(40) 



Proof of Propositions ^ and [|. Identities ( ^7| ) and ( |38| ) are immediate from 
the definitions. 

To prove identity (^l|), we note that the number of two-rowed arrays 

ai < a-i+i a-1+2 ■ ■ ■ a ai ... a k < £1 (AI } 

OL 2 < h . . . b k < £2 

that obey 

bi<a i+d + D+l, i = 1,2,..., k, (41b) 



is the number of all two-rowed arrays of the form (41a) minus those that 
violate the condition ( [41b] ). Clearly, the generating function for the former 
two-rowed arrays is given by the first term in the sum on the right hand side 



of (|39| ). We claim that the two-rowed arrays of the form (11a) that violate 

m 

(42) 



(41b) are in one-to-one correspondence with two-rowed arrays of the form 
a 2 - D < a ... c fc _ d _i < £1 



ai + D < d-i-2d-\ d-i-2d ■ ■ ■ d di ... dk-d-i < £2- 

(In particular, if fc < d then there is no two-rowed array of the form (f42|), in 
agreement with the fact that there cannot be any two-rowed array of the form 



(41a) violating (41b) in that case.) The generating function for the two-rowed 



arrays in (143) is 



( £1 — ct2 + D + 1\ f £ 2 — on ^ D + 1 



4^ V k-d-l I \ k + l + d- 

k 



1 
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which is exactly the negative of the second term on the right-hand side of 
( |39| ) . This would prove (|3^) . So it remains to construct the one-to-one corre- 
spondence. 



The correspondence that we are going to describe is gleaned from 18 1, see 
also Jl5|, Sec. 13.4] arid jl(|. Take a two-rowed array of the form (41a) that 
violates condition ( 41b ), i.e., there is an index i such that 6j > cii + d + D + 1. 
Let / be the largest integer with this property. Then map this two-rowed 
array to 



a 2 -D< (h-D) 
ai+D < (a_ ;+1 +L>) 



(on 



-D 



. . . (bi-i—D) a I+d+l ... a k <£i 
bi b k <e 2 - 



Note that both rows are strictly increasing because of — D < bj + i — 
D — 2 < ai + d+i - If I = 1) we have to check in addition that a 2 — D < ad+2, 
which is indeed the case, because 

a-d+2 > a-d+i + !>•••> CL-i+i + l + l + d>ai + l + l + d>a2-D. 

Similarly, it can be checked that bi-i — D < E\ if / = k — d. It is easy to see 



that the array is of the form (42) 



The inverse of this map is defined in the same way. Take a two-rowed array 
of the form ([l2|) . Let J be the largest integer such that dj > cj+ d + D + 1 , if 
existent. If there is no such integer, then let J = — d. We map this two-rowed 
array to 



ai < (d-i-2d-i-D) 

OL 2 < (ci + D) ... {cj +d + D) dj 



(dj-i-D) c 



J+d+l 



Cfe-rf-1 < £\ 
dk-d-1 < £2 



Since we required I + d > the entry d. 



7-1 



D exists even if J 



-d. This 



implies that the two-rowed array we obtained violates condition (lit), since 
dj > dj-i + 1 = (dj-i — D) + D + 1. As above, it can be checked that both 
rows are strictly increasing, even in the case J = —d, and that the array is 
of the correct form. 

Equation (^) is an immediate consequence of ([59]) and the definition 
of TA*(l;A,E;f,d). □ 



Proposition 4. Let L be an arbitrary ladder given by a function f by means 
of (0), let A = (0:1,0:2)) E = (51,62) be lattice points in L, and let d be a 
nonnegative integer and I an integer such that l + d > 0. Then for all x € [0, a] 
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such that a 2 < f{x) < e 2 + 1 we have 
GF (TA(l; A, E;f,d);z^ 2 ) 

El 

= J2 GF (TA(l + d; A, (j-l,f{x)-l);f,0);z^ 2 ) 

j=x+l 

■GF (TA*(-d; {j,f{x)),E; f,d);z^ 2 ) 



J2 GF (TA(l + d - e; A, (e u f(x) - 1); /, e); z \ 



1/2) 
e=0 



£2 - /(l) + l\( d -e)/2_ (43) 



(44) 



<i — e 

Proof. We show this recurrence relation by decomposing an array 

ct\ < a-i+i a-i +2 ■ ■ ■ a_i a a x . . . a fe < e\ 
a 2 < h ... bk < e 2 



in TA(l; A, E; f, d) — the generating function of which is the left-hand side 
of (|43| ) — into two parts. Let / be the smallest integer with bj > }{x), or, 
if all bj are smaller than f(x), let / = k + 1. Now we have to distinguish 
between two cases. 

If J + d < k + 1, we decompose such an array into the array 

d\ < a_ (+ i a_2 +2 . . . a-i a a\ . . . a<j+i • • ■ a/-i+d < a I+d - 1 
a 2 < bi ... < f(x) - 1 

in TA(l + d; A, (a/ + d — 1, f(x) — l); /, 0), and the array 

ai+d < a>i + d ... afc < ei 

/(a;) < 6/ . . . ... b k < e 2 

in T!A*(— <i; (a/ +( j, /(^)) , E; f, d). Clearly, this is a pair of two-rowed arrays 
enumerated by the first sum in the right hand side of (f43|), with the summa- 
tion index j equal to ai +c [. 

Ifl + d>k + l, we decompose ( [44[ ) into the array 

a\ < a_ i+ i a_; +2 • ■ ■ a-i a ai . . . a fc _/ +2 ... a fe < £i 

a 2 < 6i . . . < f(x) - 1 

in TA(l - I + k + 1; A, (e 1 , /(x) - l) ; /, d + I - k - 1), and a single row 

f(x) <&/... b k <e 2 . 

Note that, if / = fc + 1, this row is empty. These pairs are enumerated by 
the second sum on the right hand side of ([43|), with the summation index e 
equal to d + I — k — 1. □ 
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Now, here is the second method for determining GF(TA(l] (ax, 0:2)5 
(ex, 62); f, d)); zl'l/ 2 ) for any given ladder L of the form (||), with points 
A = (ai,a2) and E = (ex, £2) located inside L: partition the border of 
L, i.e., the set of points {(x, f(x)) : x £ [0, a]} into horizontal and diag- 
onal pieces, say L 1 , L 2 , . . . , L m , where L l = {(x,f(x)) : Xi^i < x < Xi}, 
for some —1 = xq < x\ < x-i < ■ ■ ■ < x m — a, each L % being either 
horizontal or diagonal. Then apply the recurrence (43) in succession with 
x = x m _i, x m _2, ■ ■ ■ ,xi and use (|37j)-([40|) to compute all the occurring gen- 
erating functions. 

To give an example, in the case of the ladder of Figure 2 we would choose 
m = 3, Xx = 3, X2 — 7, X3 = 13, and the resulting formula reads 



GF{TA(l;A,E-J,d);z^) = 



k-d/2 

j=8 k>Q 



ex -3 V £ 2-12 
k-d-l) \ k 



■3-1 

y z ki+k 2 +{i+d)/2 

, i=4 fci,fe 2 >0 



+ E z kl+{l+d)/2 

fci>0 




E 



=0 



E 



i=4 k!,k 2 >0 



z k 1+ k 2 + (l+d~e)/2( \(7-a 2 



kx + 1 + dj \ kx 



EE- 



7 k+(l+d+e)/2-f 

f=0 k>Q 




If L consists of not too many pieces, both methods are feasible methods, 
see our Example in Section [| Both methods yield (2m — l)-fold sums if the 
partition of the border consists of horizontal pieces throughout. However, the 
second method is by far superior in case of long diagonal portions in the 
border of L, since then Kulkarni's formula involves a lot more summations. 
For example, when we implemented formula ( [45| ) (in Mathematics) it was 
by a factor of 40.000 (!) faster than the corresponding implementation of 
formula (|3^) . (Indeed, the "simplicity" of the formula ( |33| ) in comparison to 
(Eq) is deceptive, as (p3) involves an 11-fold summation in that case, whereas 
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( (45[ ) has only 3-fold, 4-fold, and 5-fold sums.) Of course, in the worst case, 
when L consists of 1-point pieces throughout, both methods are nothing else 
than plain counting, and therefore useless. For computation in case of such 
"fractal" boundaries it is more promising to avoid Theorem ^ and instead 
try to extend the dummy path method in Jl9[ such that it also applies to the 
enumeration of nonintersecting lattice paths with respect to turns. 
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